TECHM'C&L REPORT SECTtOiM 
NAVAL PO^TTGRAOUATE SCf^OL 
MONTEREY. CALIFORNIA 93340 



NPS-55MtPh76051 



NAVAL POSTGRADUATE SCHOOL 



Monterey, California 



ANALYSIS OF DEFICITS IN 
DISCRETE TIME RESOURCE ALLOCATION PROBLEMS 
WITH CORRELATED SUPPLIES AND DEMANDS 



by 

K. T. Marshall 
and 

F. R. Richards 
May 1976 



Approved for public release; distribution unlimited. 
Prepared for; 

Office of Naval Research, Arlington, Virginia 22217 



FEDDOCS 
D 208.14/2: 
NPS-55MTRH76051 





NAVAL POSTGRADUATE SCHOOL 
Monterey, California 



Rear Admiral Linder Jack R. Borsting 

Superintendent Provost 

The work reported herein was supported by the Foundation Research 
Program of the Naval Postgraduate School with funds provided by the 
Chief of Naval Research. 

Reproduction of all or part of this report is authorized. 



Prepared by; 



UNCLASSIFIED 



SECURITY CLASSIFICATION OF THIS PAGE (When Data Entered) 



REPORT DOCUMENTATION PAGE 


READ INSTRUCTIONS 
BEFORE COMPLETING FORM 


1. REPORT NUMBER 2. GOVT ACCESSION NO. 

NFS 55MtRh760506 


3. RECIPIENT'S CATALOG NUMBER 


4. TITLE fand Su6(/t/e> 

Analysis of Deficits in Discrete Time 
Resource Allocation Problems with 
Correlated Supplies and Demands 


5. TYPE OF REPORT 6 PERIOD COVERED 

Technical Report 


6. PERFORMING ORG. REPORT NUMBER 


7. AUTHORfs; 

K. T. Marshall 
F. R. Richards 


8. contract or grant NUMBERr«; 


9. PERFORMING ORGANIZATION NAME AND ADDRESS 

Naval Postgraduate School 
Monterey, California 93940 


10. PROGRAM ELEMENT. PROJECT, TASK 
AREA & WORK UNIT NUMBERS 

61]52N, RR 000-01-10 
N0001476WR60052 


11. CONTROLLING OFFICE NAME AND ADDRESS 

Office of Naval Research Foundation 
Arlington, Virginia 22217 


12. report date 

May 1976 


13. NUMBER OF PAGES 


14. monitoring AGENCY NAME & ADDRESS^// d///«r©nf from Controtling OUic9) 


15. SECURITY CLASS, (of this report) 


15*. DECLASSIFICATION/ DOWNGRADING 
SCHEDULE 


16. DISTRIBUTION STATEMENT (of this Report) 

Approved for public release; distribution unlimited. 


17. DISTRIBUTION STATEMENT (of the abatract entered fn Block 20, If diUerent from Report) 


18. supplementary notes 


19. KEY WORDS (Continue on reverse aide if necessary and identify by block number) 

Budgeting 

Queueing 

Resource Allocation 


20. ABSTRACT (Continue on reverse side If necessary and identify by block number) 

This paper is primarily concerned with the stochastic behavior of 
deficits in discrete time resource allocation problems when de- 
mands for resources are random and when future allocations are 
based on past demands. The effects of various allocation policies 
are analyzed, and the sequence of deficits is shown to be re- 
lated to waiting times and queue sizes in queuing systems. A 
number of applications are described, and a budgeting problem is 



DD,j°r73l473 edition OF 1 NOV 65 IS OBSOLETE UNCLASSIFIED 

S/N 0 102-014- 6601 

SECURITY CLASSIFICATION OF THIS PAGE (Whmn Dmtm Bntmrmd) 




TABLE OF CONTENTS 



Section Page 

Introduction 1 

1 Examples 1 

2 Single period 4 

3 Multiperiod Correlation 7 

4 Interpretation in Standard Queueing 14 

5 Conclusions and Suggestions for Future Work. . 15 

List of References 18 



Introduction 



Let {X^} and {B^}, i - 0,1,2,..., be sequences of nonnegative 
random variables and define the sequence {d^} by 

Dn+i = niax (o,D^ + - B^), n=0,l,2 (1) 

Equation (1) will be familiar to any reader who has studied the 
single channel queue with FIFO order of service. If X^ is the 

service time of customer n and B is the time between arrivals 

n 

of customers n and n+1 , then, if customer 0 starts a busy 
period (Dq = 0) , represents the delay in queue of customer 

n (see, for example, Kleinrock [1975], p. 278) 

The purpose of this paper is to analyze the distribution of 
for a class of correlations between {X^} and {B^}. In section 1 

we give a number of examples, including a budgeting problem, which 

can be modelled by equation (1) with such correlations. This 

budgeting problem is used to illustrate our analyses. In section 2 

we analyze the case B = X ^ . In section 3 we extend our results 

n n-i 

to the case where B is a convex linear combination of X , through 

n n- X 

X „ for some £ ^ 1. In section 4 we interpret our result for the 
n-£ 

G/G/1 queue, and in section 5 we suggest areas for future study. 

1 . Examples 

Consider a budgeting process in discrete time, where demands 
for funds occur over time, and unused funds budgeted in a given 
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period cannot be carried forward, but where unfilled demands are 
carried forward. Examples of such budget processes occur in 
government agencies operating from one fiscal year to the next. 

If is the demand for funds in period n, and the budget 

allocated to period n, then is the budget deficit at the 

start of period n+1. For an example in the U. S. Navy supply 
system, see Daeschner [1975]. The budgeting problem is the example 
that we pursue in this paper. However, the following examples also 
fit the same structure of equation (1) . It is left to the reader 
to interpret our results for these examples. 

Consider a job shop which is scheduled in discrete time 
periods. Let be the demand in period n for some resource 

such as manhours. Such a resource, if not used in the given period, 
is lost. Let be the amount of resource allocated by a planning 

process for period n. Although unused resources like manhours 
cannot be carried forward from period to period, unfilled demands 
for these resources must eventually be satisfied. Thus, repre- 

sents the work backlog at the start of period n. 

Consider now a reservoir control problem. Let the water 
output in period n be B^ and assume that the input to the 

reservoir in period n is X^ . Let be the reservoir content 

at the start of period n. Then the sequence | D^j satisfies 

equation (1) (assuming infinite reservoir capacity) . 
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Consider next a periodic-review inventory process with a single 

perishable item. Let X be the demand in period n and B the 
^ n n 

stock which arrives in period n. Let D be the amount on back- 

n 

order at the start of period n. Again the sequence | 
satisfies (1) . 

Finally, equation (1) can be given the following queueing 
interpretation. Consider a service system which is reviewed 
periodically. Let be the total number of arrivals in period 

n and the total service capacity in period n. Then 

represents the "queue" at the start of period n+1. 

Unlike the simple GI/G/1 queue discussed in the intro- 
duction, in the above examples it may not be realistic to assume 
that the two sequences |x^[ and jB^j are independent or that 

each is a sequence of iid random variables. In the following 
sections we investigate the behavior of for a number of 

cases where the two sequences are correlated. 

We end this section with a well known result (see, for 
example, Kleinrock [1975], p. 278), that if ~ ^n ~ ^n ' 

then 

°n+l = Max(0,U^,U^ + U^_^,...,U^ + + ... + + uj (2) 

Equation (2) which is equivalent to equation (1) will be important 
in our analyses. 



3 



2 . 



Single Period Correlatio n 



In this and later sections we focus on the budgeting 
example discussed earlier. Let the sequence of demands {x^} 

be iid random variables with finite first moment y and 
distribution function F, and let the budget allocated to 
period n be equal to the demand in period n-1. Thus, 

T , n > 1. (3) 

n n-i 



Let be an independent random variable distributed as 
X^ . From (3) and the definition of we have. 



U + U , + ...+U .= X -X 

n n-1 n-i n n-i-1 



i = 0,1,... ,n-l (4 ) 



and 



U !- U T + . . . + U,v = X - 
n n-1 0 n 0 



Thus, from (2) 

D ^, = Max f0,X - X wX - X _, ...,X - Xr>,X„-B^\ 

n+l \ ' n n-1 n n-2' n 0' n 0/ 

which can be rewritten as 

D = Max ( 0, X - Min (X ^ ,X „ , . . . ,X^,Bf^)'l. (5) 

n+l \ n n-1 n-2 0 0 / 



Now, let m = inf {x | F (x) >0 } . Clearly, m is the minimum demand 
that could occur in any period. If we let 



Y = Min 
n 



^n-l'^n-2' 
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then 



“n+1 


= Max(0,X - Y ) 
n n 


and 


(6) 


P[Vn 


> y] = [l-F(y)]'^ = 


[F(y) 


(7) 


where F (y) 


= 1 - F(y) . 







By using conditional probability arguments, we determine the 
distribution of from (6) and (7) to be 






] = Fix~)+J j^F ((u-x)"j 



n 



dF(u) , 



X ^ 0. (8) 



From the definition of m. 



F(x)^ -> 1 for X < m and F(x)*^ 0 for x > m. 

Thus we see that ^ | converges in distribution to a random variable, 

say D, with distribution function D(x), where 

D(x) = F (m + x) , X > 0. 

From (8) it is straight forward to show that 



E (D 



n+1 



= y 




n+1 



du 






and therefore, 

E (D) = y - m. (9) 

The above equations show that the budgeting process can be 
operated without planned surplus resources, i.e. ~ 
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and deficits remain small and well behaved. In the language 
of queues, (9) would indicate that the single channel queue 
can be operated with traffic intensity 



E[B ] 

P = — = 1 

EIXp) 

and with finite (indeed small!) waiting times. This result needs 
closer scrutiny, and we return to it in section 4. 

Let i be the index of a period with = 0 and let 

K(>i) be the first succeeding period with zero deficit. Now 
let N = K - i+1. -In queueing theory, N is analogous to the 
number of customers served in a busy period. Now 

{N>n} <=>{Uj^>0, + U2>0, . . . ,0^^ + + ... + > 0} . (10) 



Using (3) and (4) , (10) can be shown to be 



{N>n} <=> {X^>X^,X 2 >X^, . . . ,X^>X^} . 



Since the demands {X } are assumed to be iid, 

n 



P(N>n) = / F(u)’^dF(u) = / 

0 



n = 0,1,2, . . . (11) 



independent of the demand distribution F. Thus, although the 
"busy periods" are finite with probability 1, they have an infinite 
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is the surplus 



mean. This would lead us to believe that if S 

resource at the end of period n (which is lost at the beginning 

of period n + 1), then, for large n, S would be zero with 

n 

probability 1. We now show this to be the case. First, note 
that 

S = Max (o^B - (D + X )) . 
n ' n n n / 



Combining this equation with (1) yields 



D 



n+1 



S = D + X - B 
n n n n 



where ^n+l^n ~ Taking expected values in this equation 

gives 

E[S^] = 0. 

Here we have assumed n large so that E[D .,] = E[D ]. Since 

n+1 n 

is a non-negative random variable, it must be zero with 
probability 1. 



3 . Multiperiod Correlation . 

In this section we extend the results in section 2 by 
letting the budget in period n be a function of the demands in 
periods n-1, n-2 , . . . , (n-iU for some fixed integer 1 . Specifi- 
cally, let a^ ^ 0 and ~ If 

I 

B = y a.X ., n=0,l,2,... (12) 

n . ^ , 1 n-i ’ ' 

1=1 
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For n < J-/ we require the introduction of the additional random 
variables that will be well-defined. 

As with ! X . ! . we assume that ! X , , X X . ! is 

I 1) 1=0 1-1 -2 -I \ 

a set of iid random variables with distribution function F. 
Note that ja^l'^a^ = l,a^ ^ o[ contains the 3 special cases : 

a) a^^ = 1, a^ = 0 for i < , 



b) a^ = 1/1 i Z , 

(1-a) 

c) a . = — , 0<a<l, i:^£. 

^ ,1 Z) 

(1 - a 

Case b) gives the arithmetic average and case c) gives 
as a truncated exponentially weighted average of the past 

demands (see, for example, Brown [1959]). The model in section 
2 is the case a) with 2, = 1 . In all cases given by (12), B^ 

is an unbiased estimate of y , the expected demand in a period. 



A )cey to our analysis in this section is the following 
Lemma: For fixed £ > 1, let the budget B^ be given by (12) , 



and let A. 

1 



Z 

I 



3=1 



a . . 
3 



If we define 



V 

n 



i=l 



A-X . , 
1 n-i+1 



n = -1,0,1,..., (13) 
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Therefore 






X 



V 



n 



M > X 
n 



> P 



V 



n 



M. 



k(n) 



> X 




But and independent and 

'“k(n) > = [v(x)]''‘">. 

Thus 



“n+l " =< 



-> /[-( 
*'x 






dV(n) 



(16) 



Combining (15) and (16) gives 



V(x) - f V(u-x)^^^^ 


dV(u) 


s F 


D > X 

n+1 


^ v|x + m(A,2)j . (17) 


J 

X 










As n ^ 00 / V(u)^^^^ 1 


for 


0 ^ 


u ^ m (A, 2) 


^ 0 


for 


m (A, 


,2) < a. 





Thus 



/ 



(u-x)^^’^^dV(u) 



V ^x + m (A, 2. )j - 



V(x) = V(x) - V X + m(A,2) 



X 



When this result is used in (17) , we have that 



By integration over x in (17) , it is straight forward 



to show that 



V 



- J V(u)^ ^ ^ j V(u)du, 



(18) 



m(A,£ ) 



where v 



= ^K] = \ • 

1-1 



Taking the limit in (18) , we see that 






n+1 



(y - m) E A. . 

i=l ^ 



(19) 



Notice that, as in section 2, the deficits remain bounded without 
planned surplus resources |i.e., E j = E j • 



Now we look at the random variable N, and note that (10) 
still holds. Using the result in the proof of the lemma that 



U = V - V T , 
n n n-1' 



In > n} <=> |v^ > v„, Vj > 



Now 



> Vg.Vj > Vp > Vo) =>,lVj > Vp.Vjj > V„ >Voj, 

where again k(n) = [ ^ j ' n < 2. the event on the right 

hand side is taken to be the certain event. Then it is easy to 
show that 



N > n 



k(n)+l 
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r 

Of course this does not show that ^ J 
to be the surplus resource at the end 



the same method as in section 



^[^n] 



"busy periods" never end with probability 
in fact infinite. 



is 

of 

0 

1 



finite. By defining 
period n, and using 



for large n. Thus 
and hence eTn 



IS 



We now look at some specific examples of the budget policy 
given in (12). First, let a^ = 0 for i = 1, 2,..., 2,-1, and 

=1. Thus, B = X which sets the budget in period n 

equal to the demand in period n - 2- . Then = 1 for 

I 

i = 1, 2, ...,2 and A. = 2. Then D(x) = F (x + m2), and 

i=l ^ 



E^dJ = (M - m) . Thus, if we considered a sequence of policies 
with parameter 2, we see that the equilibrium deficits stochastically 
increase linearly with 2,. We conclude that if such a budget 
policy is to be used, it is best to use the demand for the most 
recent period for which information is available. Notice that if 
the demand is not deterministic, then y - m > 0 . One can think 
of the budgets and demands being less dependent as 2 increases. 

Note that as 2 our result is consistent with that of the 



GI/G/1 queue with P = 1, namely that E 
large. 



D 



become infinitely 



Suppose that we interpret equation (12) to be an attempt 
to forecast the demand in period n from data on past demands. 
Having obtained a forecast, one would then allocate matching re- 
sources. The best (or BLUE) estimator of the expected demand 
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is obtained by setting = l/£, i ^ in equation ( 12 ) and 

using large (recall our demands are stationary) . But if the 
objective is to minimize deficits, we see from (19) that the 
optimal weights in (12) are a^=l, a^=0, i> 1. These 
weights minimize both the expected deficit and the variance of 
the deficit. In fact, the reader can verify that the deficit 
with Jl = 1 is stochastically smaller than any other case which 
satisfies ( 12 ) . 

4 . Interpretation in the Standard Queueing Model 

The budget policies defined by (12) are physically 

realizeable when n in (12) indexes discrete time periods. In 

such cases, it is possible to know X . for some positive £ 

ri “ X/ 

in time to set the budget for period n. In the case of the 
single channel queue where n indexes the customers in order of 
arrival and service, a policy of would imply that 

arrivals could be scheduled, and that the interarrival time 
between customers n and n + 1 , B^, should be set equal to 

the service time of customer n-£, namely with £ = 1 

leading to the shortest delays in queue. 

For simplicity, let m = 0. Then from (14) ^^ 4-1 “ 

with probability 1 in steady state. Now, if B^ = then 

D,, = X + X T + ...+X rt,,. The situation is drawn in 

n +1 n n -1 n-£+l 

fijure 1 for £ = 3 and the queue in steady state. Note that 
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and occur simultaneously. Clearly, such a situation 

cannot be realized unless the service time X _ is known by 

the time customer n-3 starts service. When this is the case, 
customer n+1 is scheduled to arrive at the completion of service 
of n-3. Thus, there are always exactly 3 customers in the 
system. 



(n) 



(n+1) 



(n+2) 



Arrivals 



B 



n 



B 



n+1 



B 



n+2 



(n+3) (n+4) 

B 



n+3 



-±_ 



D 



n 







Figure 1 : Steady State Realization with 

& = 3 , a ^ = 1 , m = 0 . 



5 , Conclusions and Suggestions for Future Work. 

In this paper we have identified applications of the 
"waiting time" random variable outside the standard applications 
in queueing theory and have illustrated them by examples in 
budgeting. To make the applications realistic, we allowed the 
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"service times" and "inter-arrival times" to be correlated. For 
a simple class of correlation relationships we determined the 
distribution (or bounds on the distribution) for the "waiting 
times" and for the "busy period" and we showed that the process 
with traffic intensity of unity (no excess budget) can operate 
1) with small waiting "times" (deficits) , 2) without planned 
"idle times" (surplus funds) , and 3) with infinitely long expected 
"busy periods." We also show, where is an unbiased linear 

estimate of y, that it is optimal to select a^^ = 1, i.e., 

B = X , , in order to minimize both the expected value and 
the variance of the "waiting times." 

Because of the plethora of results for the single-channel 
queue with independent service and interarrival times, our results 
may surprise many of our readers. Certainly, most were initially 
non-intuitive to the authors. We see from these results some of 
the consequences of the assumption of independence of the sequences 
!b ! and )X j . In particular, we see that some forms of correlatior 
between the two sequences enable one to schedule resource utiliza- 
tion very efficiently. 

One can postulate more complex interrelations both 
between and within the sequences j | and j bJ. For example, 
demands may not be iid random variables. They may be independ- 
ent but growing, or they may be serially correlated. There is 
much evidence (see , for example, Capra [l974j and Gaver |1975 ) 
that in governmental budgeting the appropriation of funds depends 
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on previous appropriations as well as demands and deficits. 



Although some statistical work has been carried out 
"within-sequence" correlations, the authors believe 
is much work to be done in analyzing the effects of 
lated budgeting policies on deficits and surpluses. 



to demonstrate 
that there 
such corre- 
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